Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PostgreSQL Filebeat: Define fields.epr.yml #19127

Merged
merged 1 commit into from
Jun 12, 2020

Conversation

kvch
Copy link
Contributor

@kvch kvch commented Jun 11, 2020

This PR defines additional fields referenced in the ingest pipeline.

The file is used by the import-beats script to include them in integration packages.

@kvch kvch added the Team:Services (Deprecated) Label for the former Integrations-Services team label Jun 11, 2020
@kvch kvch requested a review from mtojek June 11, 2020 12:02
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jun 11, 2020
@elasticmachine
Copy link
Collaborator

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19127 opened]

  • Start Time: 2020-06-11T12:03:19.500+0000

  • Duration: 56 min 38 sec

Test stats 🧪

Test Results
Failed 10
Passed 3929
Skipped 672
Total 4611

Test errors

Expand to view the tests failures

  • Name: Build and Test / Filebeat Mac OS X / test_file_disappear – test_crawler.Test

    • Age: 1
    • Duration: 1.971
    • Error Details:
  • Name: Build and Test / Filebeat Windows / test_close_renamed – test_harvester.Test

    • Age: 1
    • Duration: 0.552
    • Error Details: [Errno 2] No such file or directory: 'C:\Users\jenkins\workspace\Beats_beats-beats-mbp_PR-19127\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_harvester.Test.test_close_renamed\registry/filebeat/data.json'
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file – test_registrar.Test

    • Age: 1
    • Duration: 3.652
    • Error Details: 'NoneType' object is not subscriptable
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file_inode – test_registrar.Test

    • Age: 1
    • Duration: 5.975
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file_with_restart – test_registrar.Test

    • Age: 1
    • Duration: 6.385
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_0 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 3.421
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_1 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 1.73
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_faulty_6_3_1 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 1.889
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_latest – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 2.072
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_single_file_to_folder_hierarchy – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 2.285
    • Error Details:

Steps errors

Expand to view the steps failures

  • Name: Mage build unitTest

    • Description: mage build unitTest

    • Duration: 23 min 27 sec

    • Start Time: 2020-06-11T12:28:41.758+0000

    • log

  • Name: Report to Codecov

    • Description: curl -sSLo codecov https://codecov.io/bash for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat do FILE="${i}/build/coverage/full.cov" if [ -f "${FILE}" ]; then bash codecov -f "${FILE}" fi done

    • Duration: 1 min 28 sec

    • Start Time: 2020-06-11T12:52:15.590+0000

    • log

  • Name: Recursively delete the current directory from the workspace

    • Description: script returned exit code 1

    • Duration: 1 min 10 sec

    • Start Time: 2020-06-11T12:54:28.881+0000

    • log

  • Name: Mage build unitTest

    • Description: mage build unitTest

    • Duration: 10 min 7 sec

    • Start Time: 2020-06-11T12:30:31.256+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-06-11T12:57:52.845Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-11T12:57:52.845Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-06-11T12:57:52.845Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-06-11T12:57:53.343Z] + curl -sSLo codecov https://codecov.io/bash
[2020-06-11T12:58:19.969Z] + FILE=auditbeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-06-11T12:58:19.969Z] + FILE=filebeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-06-11T12:58:19.969Z] + bash codecov -f filebeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.969Z]   _____          _
[2020-06-11T12:58:19.969Z]  / ____|        | |
[2020-06-11T12:58:19.969Z] | |     ___   __| | ___  ___ _____   __
[2020-06-11T12:58:19.969Z] | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
[2020-06-11T12:58:19.969Z] | |___| (_) | (_| |  __/ (_| (_) \ V /
[2020-06-11T12:58:19.969Z]  \_____\___/ \__,_|\___|\___\___/ \_/
[2020-06-11T12:58:19.969Z]                               Bash-20200602-f809a24
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.970Z] ==> Jenkins CI detected.
[2020-06-11T12:58:19.970Z]     project root: .
[2020-06-11T12:58:19.970Z]     Fixing merge commit SHA
[2020-06-11T12:58:19.970Z]     Yaml found at: codecov.yml
[2020-06-11T12:58:19.970Z]     -> Found 1 reports
[2020-06-11T12:58:19.970Z] ==> Detecting git/mercurial file structure
[2020-06-11T12:58:19.970Z] ==> Reading reports
[2020-06-11T12:58:19.970Z]     + filebeat/build/coverage/full.cov bytes=261361
[2020-06-11T12:58:19.970Z] ==> Appending adjustments
[2020-06-11T12:58:19.970Z]     https://docs.codecov.io/docs/fixing-reports
[2020-06-11T12:58:30.102Z]     + Found adjustments
[2020-06-11T12:58:30.102Z] ==> Gzipping contents
[2020-06-11T12:58:30.102Z] ==> Uploading reports
[2020-06-11T12:58:30.102Z]     url: https://codecov.io
[2020-06-11T12:58:30.102Z]     query: branch=PR-19127&commit=54da4bd46f1842cce40d5b2291c9ddd26b43080a&build=1&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-19127%2F1%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=19127&job=
[2020-06-11T12:58:30.102Z]     -> Pinging Codecov
[2020-06-11T12:58:30.102Z] https://codecov.io/upload/v4?package=bash-20200602-f809a24&token=secret&branch=PR-19127&commit=54da4bd46f1842cce40d5b2291c9ddd26b43080a&build=1&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-19127%2F1%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=19127&job=
[2020-06-11T12:58:30.102Z] HTTP 400
[2020-06-11T12:58:30.102Z] Please provide the repository token to upload reports via `-t :repository-token`
[2020-06-11T12:58:30.102Z] + FILE=heartbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=libbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=metricbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=packetbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=journalbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-06-11T12:58:33.378Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:33.725Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-11T12:58:33.747Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Lint
[2020-06-11T12:58:33.898Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-06-11T12:58:34.049Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-Windows
[2020-06-11T12:58:34.203Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-06-11T12:58:34.357Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack
[2020-06-11T12:58:34.524Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-06-11T12:58:34.679Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-oss
[2020-06-11T12:58:35.124Z] + cat
[2020-06-11T12:58:35.124Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-11T12:58:35.124Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-11T12:58:41.723Z] runbld>>> runbld started
[2020-06-11T12:58:41.723Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-11T12:58:42.667Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19127' in order of occurrence in the config (last value wins).
[2020-06-11T12:58:44.054Z] runbld>>> Debug logging enabled.
[2020-06-11T12:58:44.054Z] runbld>>> Storing result
[2020-06-11T12:58:44.315Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-11T12:58:44.315Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200611125843-D99E9F61
[2020-06-11T12:58:44.315Z] runbld>>> Adding system facts.
[2020-06-11T12:58:45.260Z] runbld>>> Adding vcs info for the latest commit:  e7ff998cd72d6982f3af6c6d32f0c0257c6ce165
[2020-06-11T12:58:45.260Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-11T12:58:45.260Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-11T12:58:45.525Z] Processing JUnit reports with runbld...
[2020-06-11T12:58:45.525Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-11T12:58:45.786Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-11T12:58:45.786Z] runbld>>> DURATION: 19ms
[2020-06-11T12:58:45.786Z] runbld>>> STDOUT: 40 bytes
[2020-06-11T12:58:45.786Z] runbld>>> STDERR: 49 bytes
[2020-06-11T12:58:45.786Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-11T12:58:45.786Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:47.169Z] runbld>>> Storing build metadata: 
[2020-06-11T12:58:47.169Z] runbld>>> Adding test report.
[2020-06-11T12:58:47.169Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:48.111Z] runbld>>> Found 13 test output files
[2020-06-11T12:58:49.065Z] runbld>>> Test output logs contained: Errors: 2 Failures: 8 Tests: 4611 Skipped: 648
[2020-06-11T12:58:49.326Z] runbld>>> Storing result
[2020-06-11T12:58:49.326Z] runbld>>> FAILURES: 10
[2020-06-11T12:58:51.238Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-11T12:58:51.238Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200611125843-D99E9F61
[2020-06-11T12:58:51.238Z] runbld>>> Email notification disabled by environment variable.
[2020-06-11T12:58:51.238Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-11T12:58:57.009Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127
[2020-06-11T12:58:57.181Z] [INFO] getVaultSecret: Getting secrets
[2020-06-11T12:58:57.255Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-11T12:58:58.129Z] + chmod 755 generate-build-data.sh
[2020-06-11T12:58:58.129Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1 FAILURE 3338359
[2020-06-11T12:58:58.129Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/steps/?limit=10000 -o steps-info.json
[2020-06-11T12:58:59.040Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-06-11T12:58:59.040Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/log/ -o pipeline-log.txt

@kvch kvch merged commit d7dd12e into elastic:master Jun 12, 2020
v1v added a commit to v1v/beats that referenced this pull request Jun 12, 2020
…ngs-archive

* upstream/master: (119 commits)
  Update filebeat input docs (elastic#19110)
  Add ECS fields from log pipeline of PostgreSQL (elastic#19127)
  Init package libbeat/statestore (elastic#19117)
  [Ingest Manager] Retryable downloads of beats (elastic#19102)
  [DOCS] Add output.console to Functionbeat doc and Functionbeat reference file (elastic#18965)
  Add compatibility info (elastic#18929)
  Set ecszap version to v0.2.0 (elastic#19106)
  [filebeat][httpjson] Fix unit test function call (elastic#19124)
  [Filebeat][httpjson] Adds oauth2 support for httpjson input (elastic#18892)
  Allow host.* fields to be disabled in Suricata module (elastic#19107)
  Make selector string casing configurable (elastic#18854)
  Switch the GRPC communication where Agent is running the server and the beats are connecting back to Agent (elastic#18973)
  Disable host.* fields by default for netflow module (elastic#19087)
  Automatically fill zube teams on backports if available (elastic#18924)
  Fix crash on vsphere module (elastic#19078)
  [Ingest Manager] Download snapshot artifacts from snapshots repo (elastic#18685)
  [Ingest Manager] Basic Elastic Agent documentation (elastic#19030)
  Make user.id a string in system/users, in line with ECS (elastic#19019)
  [docs] Add 7.8 release highlights placeholder file (elastic#18493)
  Fix translate_sid's empty target field handling (elastic#18991)
  ...
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Services (Deprecated) Label for the former Integrations-Services team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants